Prosodic scoring of word hypotheses graphs

نویسندگان

  • Ralf Kompe
  • Andreas Kießling
  • Heinrich Niemann
  • Elmar Nöth
  • Ernst Günter Schukat-Talamazzini
  • A. Zottmann
  • Anton Batliner
چکیده

Prosodic boundary detection is important to disam-biguate parsing, especially in spontaneous speech, where elliptic sentences occur frequently. Word graphs are an eecient interface between word recognition and parser. Prosodic classiication of word chains has been published earlier. The adjustments necessary for applying these classiication techniques to word graphs are discussed in this paper. When classifying a word hypothesis a set of context words has to be determined appropriately. A method has been developed to use stochastic language models for prosodic classiication. This as well has been adopted for the use on word graphs. We also improved the set of acoustic{prosodic features with which the recognition errors were reduced by about 60% on the read speech we were working on previously, now achieving 10% error rate for 3 boundary classes and 5% for 2 accent classes. Moving to spontaneous speech the recognition error increases signiicantly (e.g. 16% for a 2{class boundary task). We show that even on word graphs the combination of language models which model a larger context with acoustic{prosodic classiiers reduces the recognition error by up to 50%.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Integrating multiple knowledge sources for word hypotheses graph interpretation

We present an integrated approach for the interpretation of word hypotheses graphs (WHGs) using multiple knowledge sources. Commonly, di erent knowledge sources in speech understanding are applied sequentially. Typically, speech understanding systems, such as the Verbmobil speech-to-speech translation system, rst use a word recognizer to determine word hypotheses, only based on acoustic and lan...

متن کامل

Prosodic processing and its use in VERBMOBIL

We present the prosody module of the VERBMOBIL speech–to–speech translation system, the world wide first complete system, which successfully uses prosodic information in the linguistic analysis. This is achieved by computing probabilities for clause boundaries, accentuation, and different types of sentence mood for each of the word hypotheses computed by the word recognizer. These probabilities...

متن کامل

rosody/Parse Scoring and its Application in ATIS

Prosodic patterns provide important cues for resolving syntactic ambiguity, and might be used to improve the accuracy of automatic speech understanding. With this goal, we propose a method of scoring syntactic parses in terms of observed prosodic cues, which can be used in ranking sentence hypotheses and associated parses. Speciically, the score is the probability of acoustic features of a hypo...

متن کامل

Parse scoring with prosodic information

The relative size and location of prosodic phrase boundaries provides an important cue for resolving syntactic ambiguity , and can be used to improve the accuracy of automatic speech understanding. This paper describes an approach to scoring candidate sentence hypotheses and associated parses using prosodic phrase cues. Speciically, for each hypothesized parse, prosodic breaks are automatically...

متن کامل

VERBMOBIL: the use of prosody in the linguistic components of a speech understanding system

In this paper, we show how prosody can be used in speech understanding systems. This is demonstrated with the VERBMOBIL speech-to-speech translation system which, to our knowledge, is the first complete system which successfully uses prosodic information in the linguistic analysis. Prosody is used by computing probabilities for clause boundaries, accentuation, and different types of sentence mo...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1995